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ABSTRACT 

Version 3 of the SWRL Instructional Management System (IMS), is 

0 

a fully automated system which accepts pupil «criteriou exercises from 
remote sites and' returns reports to the same location. This paper 
^briefly describes the SWRL/IMS Version 3 system design and functional 
operation. ^ 
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FUNCTIONAL OVERVIEW OF SWRL/IMS VERSION 3- 



^ .• • . BACKGROUND 



» ^ 



, SWRL is developing an Instructional Management System to provide/- 
timely and convenient infarmation to various users concerning the 
instructional progress ,of iodividual students. SWRL/IMS Version 3 

,will be tested im schools during the 1971-72 school year. The test will 
constitute a r^al-time \:ryout of a fully automated system from data 
source to computer processing to remote outp'ut. It will also provide 
a vehicle for the**further development of the four functions de^i^ieated 

'below that constitute the ,loil'ger- range IMS objectives. 

This paper briefly describes the SWRL/lMS Version 3 system design 
and functional ^operation. To provide a background for this overview, 
the instructional system requisites and longer-range development 
objectives, related to IMS functions are summarized. 

Instructional System Requisite . ") , - 

IMS is be/ng developed to , operate in conjunction with instructional 

systems poss^sing a common subset of characteristics. Thfe first is a 

set of pre-defined educational objectives stating operationally what 

proficiency the pu^ls should exhibit at measured intervals^during 

instruction.^' The second is the instructional materials. These may take 

diverse forms, ranging from text books an4^fl^sh cards to audio tapes. 

The ^:hird characteristic is. instructional ' procedures . Specified procedur 

are oijganized to facilitate use by teachers consistent with operations 

shown t a be effective, ^e f/iurth characteristic cgmprises assessment 

• t 

in9trument3 >to detelfmine pupil proficiency. The responses to-these 
machine scannable criterion exercises may be multiple-choice item answer 



sheets (selected responses) or teacher-recorded^ verbal ansx^?ers (constructed 
* ♦ -* 

responses). The fifth is performance' decision r ule/ ^to determine 

reasonable instructional consequences. When pupil attainment is below. 

a pre-specified level, s upplemental instruction , the sixth characteristic, 

IS ^xi order. ^ • 

^'IMS is designed for successful operation with instruction systems 
possessing the above characteri stics. The SWRL jFirst'^ear Communi cation / 



Skills. Program (FYCSP) was designed specifically with these in mind. IMS 

r 

/fmay also be used with other existing systems which have been augmented 
by the addition of objectives, assessment materials and supplemental 
instruction. 

The Learning Mastery System (LMS) has incorporated two California 
state-adopted heading texts and has made them usable with the Instructional 
^l^nagement System. • / 

INSTRUCTIONAL MANAGEMENT SYSTEM FUNCTIONS • 
. IVhen completely developed SWRL/IMg will/per£6rm four Specific ^ 

if 

functions: (1) scoring and reporting of stud^n/ performance data; 

•(2) maintenance and updating of cumulative information across studeat, 

group, class or teaching unit; (3) diagnosis/ of learning, proficiency ' 

and prescription of appropriate instruction4l sequences to-those pupils 

/ ' • . 

who do not reach fititerion; '(4) co mputer gfeneration of instructional , . 

T ' ^ 

mate rials to assist pupils in attaining*'<triterion. ' - . 

^ * I ' . ^ 

' Function 1 - Scoring and RepartingZ Criterion Exercises are corrected 

and scored by computer. The followina/^nformStion can be returned to 

the C'"^ ass room: 

/ » 

./4)upil scores 

group scores and averages 



. cl-ass^ scores and averages 

. item analyses of the criterion* exercises f 

. other statistical analyses on fexercise ^d'ata 
This is bread-and-butter instructional informaCion. TSie power of IMS 
derives frOm making the information available in a timely and convenient 
form adapted to the requirements of various -u^ers, * ' . 

Function 2 - Fiie Maintenance and Updating * This function is a key 

T 

? 

IMS component. Both researchers and scho61, personnel need a record of 
cumulative data to study overall' perfoOT^ce and trends in student 
learning, and t-0 evaluate the instructional measuring instruments. To 
accomplish this, an effective design of file structures, cross reference 
tables', and pointers must be constructed. 

Function 3 - Diagnosis* and Prescription , Students Who do not reach 
criterion on unit exercises a,re identified by Function 1,* One method of 
assisting teachers to bring children to an acceptable level of performance 
is the use'of diagnostic procedures to pinpoint student, group , or 
class problems. • Here, the comprehetlgive data files of Function 2 are 
tequired to evaluate longitudinal dkta and prepare pupil performance 
profiles in an attempt to isolate^ specific learning difficulties. For 
those s,tudents whose achievement is deemed below criterion, remedial 

.suggestions will be prescribed to the teacher. 

* / ' *' • ■ 

Function 4 - Computer-Gengration of Instructional Materials , The 

three preceding •functions provide suggestions to the -teacher as to which 

materials to use for specific problems. Function 4 will provide 

cdmputer-generated prescriptive materials to overcome specific learning 

* / ' ' ^ 

difficulties. To accorablish this instructional algorithms must be 

designed and tested, / 
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Hardware Configuration . ^ ^' . ^ - ^ 

* * * * 

The SWKL/IMS= Version 3 hardware configuration will fullj^'^^iut ornate 

the dnstructional management system from dat^ source to computer ^ T' 
processing to remote output. 

Data source ii^put : Criterion exercise sheets will be entered into 
U>vi?-speed, low-cost reliable optical scanners located in schools or 
^ cfi Strict offices. 'This teletype compatible machine, developed by tfte 
Optical Scanning Corporatio;i, 'will transmit data in a dial-up mode 
through* a Eell, 103A data' set-to. the SWRL data 'concent^^ator . 

Computer processing . The processing of the criterion exercise data 
will be , carried out by* a data concentrator- on-line to a large control 
processor. The concentratpt, located at SWR]^, is of *the following 
configuration: a Digital Equipment Corporation PDP-8/I computer with 
teletype, 8K of core,, 64K of fixed disk, tferee PEC tape drives, a card 
reader, h;igh-?speed paper, tape , reader /punch, lin« printer, and CRT, The 
PDP-8 in turn will be connected over a 2000 BAUD line to a Univac 1108 
computer located at the JefePropulsion Laboratory in Pasadena, 'California. 
This machine operates under EXEC 8 and it is capable of handling reniote 
entry. 

Dat^ output . Reports from IMS will be transmitted directly to the 
» - * - ' * 

school or district office by' the data concSentrator , which receives the 

reports from the 1108 and stores them on magnetic" tape. The output 

devices will ^e either .teletype or^ low- speed line* printers. • Once 

received, the reports' are distributed to the appropriate teacher. ^ - 

4 ' • 
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, Software Design 

Two separate but interrelated concepts are» contained in the software 
^^esign of a CMI system - the communications s'oftware arid the. resident . ' 

' . ' ' ' 'A* - 

IMS programs. , . / . \ ' ' 

' communications software . SWRL/IMS Version 3 will use the SWRL \ ^ 

executive system. Operating in a data break mode,^ the system can handle 
multiple interrupts from ten hardware ports. The coimnuni. cat ions . 
prograirening is modular; the PDP-8 could communicate with^anjr dther • > ^ 

computer if - the code for that machine were known and if tTie -hardware 
interface w^re available. 
5ide^ 



ResidenV IMS software . The programs to generate reports to teachers, 
administrators and researchers will reside the 1108 computer. They 
will be written in FORTRAN IV to minimize the probl-ems of reprpgramming 
for another machine. r 

I , ' . 

\ ' ^ ' IMS OPE*RATIONAL SEQU'ENCE;^ 

The activities pertineat to SWRL/Il^S Versiqn 3 are carried bn in 
\ . three separate locations, each 'requisite for successful iristruQtional '/^ 

management. These are the school, the data 'concentrator , and the central 
protyessor. The following describes the operation in a' typical school 



' ' ' * 



liaii 



containing four kindergarten classes. 

School ^ . • . 

Pupils receive instruction in Ujiit One of the First Year C'omhiu.ni cat ions 
Skill Program. When the presentation of materials an^ practice exercises 
is completed, the pupils take a criterion referenced exercise for Unit 
. One. It is administered orally by the teacher and the pupils respond by 



filling in their chdice of response position* for each question. There 
are four 8V' X 11" answer sheets, each containing five items with three 

' ; I ' 

possible responses per item. Stimuli are presented for. each item and 
• there is space beneath each for student marking. ' k, sample anfewer sheet 
appears in Appendix A. . * ' • ^ . 

When* 'the tests have been completed, they are brought to the scanner 
where a clerk checks the answer sheet$/ for stray marks and smudge^. 
The test sheets ,prfeceded by a 9ontrol sheet identifying the district*, 
school, class, sesjsion, subject, ah<3' test number'afe fed into the 
scanner, which Ls connected to the data concentrator b^^ means of a 
telephone and, data set. Tlie scanner then transmits a pattern of 
information bits to the concentrator. When all the sheets have been read 
the scanner is turned- off an?} the phone returned to its cradle. 

Data Concentrator Site , • , ^ 

As sQpn as the scanner is connected ovex' telepl^one lines tb the data 
concentrator, all processing is stopped to receive the information. The 
source of .transmission is identified and the first series of bits is* 
stored in a buffer. Since a bit pattern image of the entire test page ' 
containing 'stimulr and responses is* transmitted, the concentrator 
•must strip the data and save only those bits contained in the response 
position, a?eJ^^s. This information is placed in disc storage-and' t;hen ' * 
later stored on magnetic tape. 

Central Computer , - , ' ' . ^ 

' The main computer receives a call from the, data concentrator to 
open files far the reception of data. These twq macfiines are' connected 
by hi,gh-speed^ direct dial telephone* lines. Onqe the data have been 
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received by the large CPU, the concentrator will ^signal the activation 
o| certain' pre-stored programs to operate on the d^ta. These programs 
correct the test.s"and generate scores for each outco_m(> and total test 
each pupil and store this' infi^rmation on a temporary output file, 
^The same data is stored in the permanent Function 2 data ,base, 

' 1 



Data Concentrator • ; , 

I Ui^on -dall from the concentrator ' the scores arp returned from the 
output file to- a temporary input file at the smaller machine, , The daita . • 
concentrator then initiates a call to, the school which has a teletype or 
line .printer and a data set in the ready condition. Reports are output 
rfor use by school personnel. Sample* output reports appear in, Apperfdix Bo 

. jln summary, the critical tasks by loca'tion are as follows: , 
School - instruction, adminis-tration of- criterion exercises, 
transmission of exercise information, reception of 
* summary reports. 

■ V. 

Data Con- . • ^ , 

centrator - identification of transmission source^ reception and 

1^'. ^ * stripping of data, te'mporary storage of raw data, 

'\ ' ' 

transmission^, of data to large CPU, reception of summary 

reports, transmission of' reports to school site,^ 



t 



Central ' * " , 

Computer - reception -of compactfed r^ data, scoring of exercises; 

updating of files, trahsmission of summary reports to 
data concentrator. 

The complete process is depicted in Figure 1, , » 
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Appendix B 



ClassiPexrforr^ance Report - Criterion l!est 4-1 
(Sample). 



s 



District' Westport ' ' - (1) 
School Eleventh Street "School (1) 



eacher 


Eve^ Campbell 


'>(!) 




lass* 


Morftins 


(1) 




• • ' ' . 


• c 


Total, 


.D No. 


Student's I^ame „ . 


(Group) 


Raw* Score 


1 
1 


U Lrtliv tl J. X i. J.^ O 


' ^ 


24 


25 


Martin Maloney 




• ^4 


2 


Alice Smith 




24 • 


7 


Dianne Aibers 


\ 


24 


13 


Janet Gaces 




23 


8 


Jose Delgado 


1 


23 


14 


Mary Harris 


1 


' . 22 ' 


19 


Helen Teary 






20 


Arthur 01 son- 


1 


• 21 






Group 

• 


Averages 


3 • 


Pamela Peters 


,2 


, 22 


4 


Fred Harper 


' 2 


21 


.0 


Patty Kenda>ll 


2 




9 


Bill Riley 


2 


21 , 


t5 


Dave Nelson 


2 


20 , • 


16 


Kurt Rotter 


2 


u 20 


22 


Jim Cook. ^ - 


2. 


20 


21 


Sally Tennon 


2 


20 




\ 


Group Averages 


::4 


Juan Marpinc2 


3 


18 


23 


LilUah Horn 


3 


18 


IS . 


Donald G\-iiy 


' 3 , 




i7 


Sylvia Strickland 


3 


17 


il 


Maurice Richter 


3. 


' 15 


12 • • 


Sibyl Betts ' 


3 


15 


o 


Ben Kaufraan • 


3 


12 


5/ 


Danny Robinson 


. 3 


10 



Group Averages 



eiass VAverage5 _ 



Outcome Score in Percentage 
Outcome Outcome' OuCcotne ^ 

1 '2 3^ ' 



100 


, 100 


•100 


100 


100 . 


100 


100 


« 100 


100 


100 • 


100 


lO'O 


100 


100 


88 


100 


100 


/ 83. 


100 


100 


75* 


100 


88 


88' 


100' 


88' 


' 75*' 


100 


, . 

• 97 


■ 90 


lOD 


100 


, 75* 


1,00 


100 


. 63* 


100 


88 


75* 


100 


88 


75* 


100 


88 , • 


63* 


88 


88 


75* 


88 


88'. 


• 75* 


88 


88 


-75* 






~72* 


~96 


"91 


100 


•75*' 


63* 


88 


75* 


50* 


88 


63* 


' 50* 


88 


• 63* 


50* 


75* 


63* 


38* 


75* 


63* 


38* 


75* 


50* 


25* 


63* 


37* 


- . 25* 




~61* 


, "42* 


93 


83 


68 



\ 



Indieat^t that tcora^ was .baloir orlttrlon 



^ Appe.ndix B (cont.) 



Class No, 1 
Unit No. 4 



Group No. 1 



Student No . 

1 , * 

2 

3 




■r 



Outcpmes 

2 3 4 



3 

4 



4 
3 
4 



Total 



19 
13 
18 



Percent of Group 
Below 5 out o£ 5 



67 



lOCr , 33 



Group No-.' 2 
Student No.« 

4 

5 



Outcomes . ' , 

.1." ■ 2 3 ■ 4 • Total 

■ • , .20 

'4 '19 

. X • • * 20 

4 4 4 4 16 



/c:\.*cen.t' of - Group, 
.ietow -S out of 5 



. .'avcetic of' Class 
iielow 5tkOut^ of 5 



^ 25 . 50 



14 • 57 



25 25 



57 29 



Appendix li . (cont . ) 



■f 



Unit No. • 4 



X^o^ No . 




Percent" Giving Response 



1- 



I 



3 • 



Correct' Re#.0|>se 



I 
2 



70 'CAT 20 CAR 10 CUP 
40 DOG 0 DIG 60 DOT 



70 CAT^ 

60 DOT 

• f 



20 



3& S 5(J C 



20 Z 



50 Q'^ 
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ITEM ANALYSIS ^REPORT BY OUTCOME CRITERION TEST 4-1. 

(Sample)' 



Mstric t Westport ^ ^'^ ^ (1) 
S choo 1 Eievenflv StreSt School X 1 ) 

.Teacher Eve Campbell ^(1) 

^Mortiing C^) 




Outcouie No. 



Pag^^No, 



Row No. 



1 


i 


1 


2 




1 


2 


. 2 






3 




A 




' 4 


\ 2 


r 


3 


1 


4 


2 


3* 


2 


'" 4* 


- 3 


\f3* 


•'3 


4* 


•' 4 


. 3* 


4 


4* 


1 


5* 


1. 


6* 


2 


,, 5* 




^ • 6* 








6*f 


4. 


..' ' 5* 


• 4 


.6* 



Correct • 
Response 

2 
1 

■ 1 
2 
2 
2 
3 
3 

• 3 
2 
1 
3 
1 
3 
1 
2 

3 
1 
3 
2 
1 
2 

1 



Positipn 



0 


1 


2 ' 


3 


0 


1 


• 24, ^ 


U 


0 


25 


0 


0 


0 


24 


1 


0 


'0 


•1 ■ 


23 ■ 


' 1 


0 


0 


22 • 


3 . 


1 


• 2 


19 


3. 


0 


0 


3 


22 


1 


' 1 ' 


1 


22 


0 


. 0 


0 


25 


0 




22 


2 


0 


20 


■ o' 


5 ' 


0 


: 5 


2 


18 


0 


21 


2 


2 


0 




.0 


19 


.0 


18 , 


2 * 


5 


'o 


2 


• 16^ 


7 


0 


. ■ 2 


3 


20 


Q .* 


21 


1 


3 


0 


2 


4 


19 




5 


15 • 


5 


I 


• 18 


' 3 


4^- 


0 


4 


15 


6 


0 , 


12 


3 


10 


0 • 


12" 


7 


6 



•J 



Figure 4 



